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(54) IMAGE DATA PROCESSOR 
(57)Abstract: 

PROBLEM TO BE SOLVED: To perform image 
processing so as to reduce quality degradation from a 
first compressed image by performing compressing 
processing only to image data in the area, to which 
image processing is performed, when performing 
compressing processing. 

SOLUTION: Image data are transformed to Y.U.V data 
(step 10), respective image data are divided into blocks 
for every 8x8 picture element (step 11), and DOT 
operating processing is performed to block pixel data 
(step 12). Quantizing operation is performed to the DOT 
operated result by the two-dimensional quantizing table 
of 8 X 8 to which prescribed data are applied (step 13). 
The 0th row and 0th column in the block matrix of DOT 
coefficient among the provided data express a DC 
component, the other rows and columns become AC 
components, and another processing is performed. As to 
the DC component, the data of difference from the block 
at the preceding position are found (step 1 4) and 
encoded by Huffman encoding (step 15). The AC components are rearranged into one- 
dimensional data arrangement (step 16) and Huffman encoding is performed for the unit of a 
block (step 17). 
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* NOTICES * 

Japan Pa'tent: Office is no't responsible for any 
damages caused by tihe use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the technique which performs an image processing, 
compresses again and creates an image data file, after elongating the data of the static image compressed 
especially beforehand about compression elongation of image data. 
[0002] 

[Description of the Prior Art] Conventionally, there is JPEG (Joint Photographic Expert Group) as an 
international-standards coding method as the compression elongation approach of a static image, and, 
generally the approach called the DCT (Discrete Cosine Transform) method of an irreversible method as 
most fundamental category is used. This DCT method is drawing 6 (a). The conventional picture 
compression and elongation processing as (b) shows, respectively are performed. 
[0003] It is the technique of carrying out high efficiency compression of what 8x8 blocked the image 
two-dimensional, and transposed to the data according to frequency component by the DCT operation 
for every block like illustration, and quantized the result by "Huffinan coding." (In addition, refer to 
explanation and drawing 1 of this operation gestalt for details) . 

[0004] In addition, as a conventional technique relevant to JPEG, the technique which chooses the 
optimal quantization table in JPEG compression processing is indicated like JP,7-135568,A. 
[0005] 

[Problem(s) to be Solved by the Invention] However, there were the following faults in the above 
conventional examples, namely, the image compressed because the image-quality-fall existed by 
quantizing the result of a DCT operation using a predetermined quantization table in case picture 
compression of the above-mentioned conventional technique is carried out — once — elongation 
processing — carrying out — what — since compression processing performed again after having 
performed the image processing of grades, when image-quality degradation increased, consequently 
multiple-times picture-compression elongation repeated, the qualitative problem that where of good 
image quality is no longer acquired was. 

[0006] Moreover, any indication is not carried out about the cure to image quality degradation in the 
case where the image data conventionally compressed also into invention is compressed again, either, 
then, even if it boils again the image by which compression processing was carried out in an image 
processing as a purpose of this invention and repeats rear-spring-supporter compression processing, it is 
in offering the image data processor which can perform an image processing whose qualitative 
degradation with the first compression image decreases. 
[0007] 

[Means for Solving the Problem and its Function] In this invention, in order to solve the above- 
mentioned technical problem and to attain the purpose, the following means are provided. 
[1] In the equipment which carries out compression processing and creates a picture compression file 
again, face for carrying out said compression processing for the second time, and provide the image data 
processor carry out carrying out compression processing only in the image data of the field gave said 
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image processing as the description, after carrying out elongation processing of the picture compression 
file and carrying out the image processing of this image concerned by which elongation processing was 
carried out as 1st solution means. 

[0008] [2] Moreover, while carrying out the image processing of the image data by which elongation 
processing was carried out to the elongation processing means which carries out elongation processing 
as 2nd solution means after dividing a picture compression file into two or more block images An 
image-processing means to describe a modification identifier in said block image which data 
modification produced, A compression processing means to carry out compression processing and to 
create a picture compression file again from the image data which the image processing was carried out 
and was obtained is provided. With said compression processing means Based on said modification 
identifier, it distinguishes whether a data change of said block image is made by said image-processing 
means. In being said block image which data modification produced, in the case of said block image 
which has not produced data modification, it offers the image data processor characterized by 
compounding a picture compression file using the image data before said elongation processing using 
the image data which carried out picture compression. 

[0009] [3] Furthermore as 3rd solution means, said picture compression and elongation processing 
provide with the image data processor of a publication [1] characterized by using JPEG, or [2]. 
[0010] (Operation) By having provided such a means, the image data processor of this invention does 
the following operations so. 

[001 1] after elongating the image compressed from the first — what — by performing the image 
processing of grades, detecting that modification occurred to the former data at the time of image 
elongation, and newly performing picture compression only about a field with data modification Even if 
picture compression is repeated about the data of a field without modification, there is no change of 
image quality, and it becomes possible to hold good image quality compared with the case where 
compressing a whole image relatively is repeated. Moreover, since picture compression is performed to 
compression processing only about an image data modification field, compaction of the processing time 
can be aimed at. 
[0012] 

[Embodiment of the Invention] It explains referring to the drawing related about the gestalt of the 
operation concerning this invention from this. 

(The 1st operation gestalt) Drawing 1 (a), (b) shows the processing section and the procedure of the 
picture compression processing and elongation processing by the "base-line method" of JPEG of the 
place which is the example of the picture compression applied to the image processing system 
containing the image data processor of this invention. 

[0013] Drawing 1 (a) shows first the picture compression processing which is the main point of this 
invention, in addition, what after carrying out elongation processing of the image data file [ finishing / 
compression ] as this premise ~ it is the case where the image processing of grades is performed and 
picture compression processing is again performed as an image file. 

[0014] First, since, as for image data, processing is carried out of R (red), G (green), and B (blue) 
component to image display, R-G-B data are first changed into the Y-U-V data disassembled into the 
"brightness" currently generally used on the handling of image data, and the "color difference" (a 
process and processing section 10). A block division is performed for the image data of each changed Y- 
U-V every 8x8 pixels (a process and processing section 11), and "DCT data processing" is performed 
for each block pixel data (a process and processing section 12). 

[0015] This DCT operation is what expressed each component of the vector of image data by the cosine 
function by the thing of "a discrete cosine transform (Discrete Cosine Transform)", and uses resembling 
the image transformation matrix. Furthermore, 2-dimensional the "quantization table" of 8x8 on which 
this DCT result of an operation was given to predetermined data performs a quantization operation (a 
process and processing section 13). This quantization is performing decreasing the entropy of a DCT 
multiplier by breaking the DCT multiplier obtained in a process and the processing section 12 by the 
data by which a quantization table corresponds. 
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[0016] Next, zero-line zero train of the block matrix of a DCT multiplier expresses DC (direct current) 
component among the data obtained by the quantization operation, others serve as AC (alternating 
current) component, and respectively separate processing is performed, moreover, difference with the 
block which DC component of them has in a front location — it asks for data (a process and processing 
section 14), and predetermined coding processing is performed by "Hufftnan coding" (a process and 
processing section 1 5). 

[0017] When asking for the data of a pre-block of DC value here, the existence of modification of the 
data within a block judges with reference to the block address of the memory which is a modification 
identifier about the block with which data were changed in the image processing, or the block which is 
not so, and when [ of the block with which it was changed, and the block which is not so ] changing, it 
asks with reference to DC value of the block location where DC value reference file 100 corresponds. 
[0018] On the other hand, AC component after a quantization operation scans the inside of a block to 
zigzag (un-illustrating), and changes it to a 1 -dimensional data array (a process and processing section 
16), and Huffinan coding of a block unit is performed (a process and processing section 17). 
[0019] The compressed data before elongation processing of the block without modification is 
compounded by the compressed data of the block with which this compression processing was finally 
performed, and the image processing currently recorded on the former file 101, and the data of a new 
picture compression file are generated (a process and processing section 18). 

[0020] As mentioned above, a series of above processings are performed about each Y-U-V data, and, 
finally become one picture compression file. Then, the process and the processing section of elongation 
processing of an image which were already compressed are shown in drawing 1 (b). According to 
illustration, the image file compressed first is called (a process and processing section 19), and the data 
for every [ of 8x8 ] block for pixel data are taken out in order on a screen (a process and processing 
section 20). Under the present circumstances, it is like the above-mentioned explanation that the image 
data file is divided into the Y-U-V data of the data format decomposed into "brightness" and the "color 
difference." 

[0021] DC component of this block of 8x8 — the "Huffman compound-ized" processing — carrying out 
(a process and processing section 21) — the difference from a pre- block ~ data are restored and DC 
value is restored (a process and processing section 22). At this time, DC value reference file 100 
explained by drawing 1 (a) is again created supposing there being compression processing. 
[0022] Moreover, similarly, "the Huffman compound-ization" is carried out (a process and processing 
section 23), and AC component within a block is restored to the matrix data of 8x8 which performed the 
reverse rearrangement of a zigzag scan which explained the 1 -dimensional data stream by drawing 1 (a), 
and escaped only from zero-line zero train (a process and processing section 24). Here, after applying 
restored DC value to zero-line zero train and restoring to the matrix data of 8x8, reverse quantization 
processing is performed using the completely same quantization table as having used it by compression 
processing, and a DCT multiplier is restored (a process and processing section 25). 
[0023] Furthermore, a "reverse DCT (IDCT) operation" is performed and the image data of Y-U-V data 
format is restored (a process and processing section 26). Finally this Y-U-V image data is changed into 
R-G-B image data, and it is changed into the image data which can be displayed (a process and 
processing section 27). 

[0024] It is carried out by the image modification processing which drawing 2 which mentions image 
processings, such as "color conversion" and "edge enhancement", later to this changed image data 
shows. Moreover, memory storage is carried out and the block address of the image block which this 
image processing was performed and data modification of an image generated serves as a "modification 
identifier" which means the mark of this being a modification block. 

[0025] With this operation gestalt, it realizes by combining the compression processing and elongation 
processing which were mentioned above. The flow chart of drawing 2 shows the rough procedure of the 
whole image processing which has "compression" and "elongation" of image data in this invention as 
main functions. 

[0026] In addition, this processing is performed by software, such as a personal computer (it is hereafter 
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called a personal computer for short). First, the software program concerned is started and processing 
starts (SI). Initialization and an initial screen like a menu screen are displayed (S2), and it becomes the 
input waiting of the selection actuation from the menu (S3). Here, when there is no operator alter 
operation, it becomes (S4) and the aforementioned step S3 with return and the same input waiting. 
[0027] Moreover, an image file is inputted by "input" directions actuation (S5), "modification" 
directions actuation performs image modification processing (S6), and image preservation processing is 
performed by "preservation" directions actuation (S7). Moreover, the above manipulation routine is not 
chosen, but the program concerned is ended, especially when "termination" is chosen, for example, after 
performing a post process (S8) which erases a screen display. 

[0028] Especially about image preservation (S7), predetermined processing about "picture compression" 
of this invention is performed among the manipulation routines of the preceding opinion here, and a 
series of processings in a process as shown in drawing 1 (a), and the processing section are performed. 
Moreover, about processing detailed to the pan performed by the program of this step S7, below is 
supplemented with explanation with reference to drawing 3 . Moreover, in the image file input of step 
S5, "image elongation" is performed and down stream processing shovm in drawing 1 (b) is performed. 
[0029] Supplementary information is carried out to drawing 3 in [ processing / which showed the 
detailed step of image preservation (S7) of drawing 2 with the flow chart, and was shown especially in 
drawing 1 (a) / compression ] program. Moreover, drawing 4 (a). The image image on monitor display is 
shown in (b), drawing 4 (a) is expressed together with the image which imagined blocking for the image 
processing, and drawin g 4 (b) shows the 1 -block pixel array. 

[0030] If the procedure outline of this compression processing progresses rightward horizontally from 
the block at the upper left of the full-screen field of an image image as drawing 4 (a) shows and comes 
to a right end, it will progress from the left of the following lower berth, and will perform each block 
picture compression processing to the lower right one by one. However, compression processing is not 
performed to the block with which image data is not changed, but a series of processing steps advance 
so that compression processing may be performed only about the block of an image data modification 
field as shown with the slash of this drawing 4 (a). In addition, each block here shall consist of 8x8 
pixels, as shown by drawing 4 (b). 

[0031] If the flow chart of drawing 3 explains concretely, first, it begins from the start (S7) of image 
preservation processing, and the address of the direction of y in xy coordinate to show the block location 
of the screen top maximum upper case in drawing 4 (a) like the preceding opinion is reset (Sll), and in 
order to show a left end, the address of x direction will be reset (SI 2). By this, an upper left block will 
be specified as a block of the first processing object. 

[0032] Next, the block of this ** distinguishes whether there was any modification of data by the image 
processing based on said modification identifier (SI 3). Picture compression down stream processing 
shown by drawing 1 (a) when there was modification of data is performed as a subroutine (SI 4). On the 
other hand, when there is no modification, the picture compression processing (SI 4) by the subroutine is 
skipped, and shifts a block location to one right by the increment of the x following values (SI 5). 
[0033] Although it fiirthermore distinguished whether the specified location of the block concemed was 
a right end here (SI 6), and the processing from the above-mentioned step 13 was repeated if it was not a 
right end, when it is a right end on the other hand, it is initialization (0) about x values. In order to reset 
a block location at a left end by carrying out (SI 7) and for the direction of y to also make it move to the 
lower berth, the increment of y value is performed (SI 8). 

[0034] If it judges whether it is the location which the coordinate value of the direction of y should be 
blocking and should be ended similarly [ here ] (S19) and has not finished yet, the processing from the 
above-mentioned step 1 2 is repeated, but on the other hand, if it is the location which should be finished, 
the return of the subroutine concemed will be ended and carried out. 

[0035] Thus, by performing a series of image preservation processings of the procedure which drawing 
3 showed, a change of only the shadow area in the DS shown in drawing 5 is made. In addition, this 
drawing 5 (a) - (c) shows the file data structure of a picture compression file, and structural drawing of 
an image file when drawing 5 (a) represses structural drawing of the original image file with the 1st 
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operation gestalt and drawin g 5 (b) represses an image, and drawing 5 (c) show structxiral drawing of the 
image file at the time of repressing an image with other operation gestalten. 
[0036] That is, the original picture compression data file of drawing 5 (a) turns into a picture 
compression file by which only the data modification field was changed as the slash of drawing 5 (b) 
showed. Explanation about the data configuration of a picture compression file which drawing 5 shows 
briefly here is given. There is the Header section in the head of the record of this file, and then a 
quantization table, a Huffman coding table, etc. are in Table. It turns out that the data corresponding to 
each block with which each block (BLOCK (0 0) - BLOCK (m-1, n-1)) was compressed are arranged at 
the DATA section which furthermore continues. 

[0037] (The operation effectiveness by the 1st operation gestalt) As operation effectiveness in this 
operation gestalt [ when performing a predetermined image processing, performing picture compression 
again and saving an image file, after carrying out elongation processing of the data file by which picture 
compression was carried out fi*om the first ] Since the block with which the data which correspond by 
the image processing were changed, and the block without modification are discriminable with an 
identifier While suppressing original image degradation, without changing most magnitude of the image 
file compressed by performing picture compression processing only in the image block with 
modification, the effectiveness of the processing time which the pictxire compression processing itself 
takes also being shortened is acquired. 

[0038] (Other operation gestalten) the difference of the data changed fi'om the former image as an option 
although the data of the modification block by the image processing of image data were replaced newly 
and it realized in the example of the 1st operation gestalt mentioned above — data — every block — 
extracting ~ difference — the picture compression of only data ~ carrying out — difference — the method 
of adding a block to the original picture compression file is also considered. 

[0039] that is, the block location data corresponding to after a former image file for the image block 
which had data modification in the abbreviation image of the data file after the picture compression 
shown in drawing 5 (c) and difference ~ data are written in. of course, this difference ~ data may be 
compared with a DATA part [ not only the last of a file but ] front, and the former block corresponding 
to a modification block, and may be file-ized. 

[0040] When using above-mentioned technique, even if it repeated an image processing and 
compression what times, the effectiveness it is ineffective to it being possible to perform modification 
processing of image data, keeping a former image data quality constant is acquired. 
[0041] Moreover, although JPEG was made into the example in explanation of the above operation 
gestalt, also when using the compression elongation means of others, such as "firactal compression", for 
example, it can apply. Moreover, although the static image was similarly dealt with by explanation, it 
can also apply also to an animation. 

[0042] Furthermore, although elongation, compression, and the case where an image processing was 
carried out were illustrated for one image data, when this image processing compounds two or more 
image files, it can also utilize. 

[0043] (Modification) With the operation gestalt as an example of this invention, since it permits each 
processing is not only performing by the program built in the personal computer, but it being processed 
by the equipment which works as a fiinctional module of the dedication depending on the class of 
processing, and realizing with the combination of software and hardware, the configuration as an image 
data processor is not limited especially strictly. 

[0044] Therefore, deformation implementation various in the range which does not deviate fi-om the 
summary of this invention in addition to this is also possible. As mentioned above, although the 
summary of this invention was explained based on the gestalt of operation, the following invention is 
included in this specification. 

[0045] [1] The image data processor carry out carrying out compression processing only in the image 
data of the field faced for performing the aforementioned compression processing for the second time, 
and gave said image processing as the description in the equipment which carries out compression 
processing and creates a picture compression file again after carrying out elongation processing of the 
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picture compression file and carrying out the image processing of the image concerned by which 
elongation processing was carried out. 

[0046] [2] While carrying out the image processing of the image data by which elongation processing 
was carried out to the elongation processing means which carries out elongation processing after 
dividing a picture compression file into two or more block images An image-processing means to 
describe a modification identifier in said block image which data modification produced. With a 
compression processing means to carry out compression processing again and to create a picture 
compression file from the image data which the image processing was carried out and was obtained, and 
said compression processing means Based on said modification identifier, it distinguishes whether a data 
change of said block image is made by said image-processing means. The image data processor 
characterized by compounding a picture compression file using the image data before said elongation 
processing using the image data which carried out picture compression when it was the block image 
which data modification produced in the case of the block image which has not produced data 
modification. 

[0047] [3] Said picture compression and elongation processing are an image data processor given in [1] 
characterized by using JPEG (Joint Photographic Expert Group), or [2]. 

[0048] (4) While carrying out the image processing of this image data by which elongation processing 
was carried out to the elongation processing means which carries out elongation processing after 
dividing a picture compression file into two or more block images An image-processing means to 
describe a modification identifier in said block image which data modification produced, A compression 
processing means to carry out compression processing again and to create a picture compression file 
firom the image data which the image processing was carried out and was obtained is provided. With 
said compression processing means The image data processor characterized by distinguishing whether a 
data change of said block image is made by said image-processing means based on said modification 
discernment, and performing picture compression processing. 

[0049] (5) an image data processor given in [1] characterized by said picture compression and 
elongation processing using "fractal compression elongation", [2], or (4). 

(6) [1] characterized by performing the image processing which compounds two or more image files, 
carrying out compression processing of the compounded image file, and creating a picture compression 
file, [2], or an image data processor given in (4). 

[0050] (7) the difference from the image data before elongation processing of the image data about the 
block image which it faced performing said compression processing and data modification produced by 
the image processing — an image data processor given in [1] characterized by carrying out compression 
processing only of the data, [2], or (4). 

[0051] (8) said difference ~ an image data processor given in (7) characterized by adding data to the 
picture compression file before **** processing, and creating a new picture compression file. 
[0052] (9) [1] which faces performing said compression processing, carries out picture compression only 
of the image data about the block image which data modification produced by the image processing, and 
is characterized by rewriting the applicable part of the picture compression file before elongation 
processing, and creating a new picture compression file, [2], or an image data processor given in (4). 
[0053] (10) the block image which it faced performing said elongation processing, and the reference file 
which shows the file location of said block image was created, it faced performing said compression 
processing, and data modification produced by the image processing, and the block image have not been 
generated in data modification - changing - it is — a case - said reference file - referring to - 
difference - an image data processor given in [1] characterized by to ask for data, [2], or (4). 
[0054] Moreover, the contents about the following down stream processing are also included. Namely, 
<1> The image data processor characterized by to have the process which performs elongation 
processing of an image data file by which picture compression was carried out, the process which 
performs an image processing in the image by which elongation processing was carried out, and the 
process which perform picture compression for the image which performed the image processing again, 
and to have further the process which chooses only the field chisel to which the image processing was 
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performed on the occasion of picture compression, and performs picture-compression processing again. 
[0055] <2> The process which performs elongation processing of an image data file in which image data 
compression was performed after dividing an image into two or more block images, The process which 
performs processing which creates the reference data in which the file location of a block image is 
shown by said elongation processing. The process which performs a predetermined image processing in 
the image by which elongation processing was carried out, and the process which performs picture 
compression for the image which performed the image processing again, The image data processor 
characterized by having further the process which performs picture compression processing based on 
said modification identifier in ****(ing), appending a predetermined modification identifier to said 
image block which performed said image processing and data modification generated and performing 
picture compression again. 

[0056] <3> the block which modification produced when performing the above <1> or re-degree picture 
compression in <2> — being related — the difference from the former data of the changed data of image 
data ~ image data processor characterized by having the process which carries out picture compression 
of the data and is added to the image file concerned. 

[0057] <4> The above <1 > or the picture compression elongation in <2> is an image data processor 
characterized by having the process which uses JPEG (JointPhotographic Expert Group). 
[0058] <5> The above <1> or the image processing in <2> is an image data processor characterized by 
making into a compressed file the image compounded at the time of picture compression processing 
when two or more image files were compounded. 

<6> Image data processor characterized by the picture compression elongation in the above <1>, <2>, or 

<3> having the process which uses "fractal compression." 

[0059] 

[Effect of the Invention] Thus, when performing a predetermined image processing, performing picture 
compression again and saving an image file after this invention elongates the data file by which picture 
compression was carried out from the first, it is set. By performing picture compression processing, only 
the image block which identified the block with which data were changed by the image processing, and 
the block without modification, and had modification It is effective in losing degradation of the image 
data of a field without image modification, and maintaining the effectiveness of suppressing image 
degradation therefore seen as a full screen, and the processing time of picture compression processing 
being shortened. 

[0060] consequently, even if it boils again the image by which compression processing was carried out 
in an image processing and repeats rear-spring-supporter compression processing, it becomes possible to 
offer the image data compression equipment which performs an image processing fi-om which 
qualitative degradation with the first compression image serves as min. 



[Translation done.] 
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• * NOTICES* 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The image data processor carry out carrying out compression processing only in the image 
data of the field which it faced for performing said compression processing for the second time, and was 
given in said image processing as the description in the equipment which carries out compression 
processing and creates a picture compression file again after carrying out elongation processing of the 
picture compression file and carrying out the image processing of this image concemed by which 
elongation processing was carried out. 

[Claim 2] While carrying out the image processing of the image data by which elongation processing 
was carried out to the elongation processing means which carries out elongation processing after 
dividing a picture compression file into two or more block images An image-processing means to 
describe a modification identifier in said block image which data modification produced, A compression 
processing means to carry out compression processing and to create a picture compression file again 
fi*om the image data which the image processing was carried out and was obtained is provided. With 
said compression processing means Based on said modification identifier, it distinguishes whether a data 
change of said block image is made by said image-processing means. The image data processor 
characterized by compounding a picture compression file using the image data before said elongation 
processing using the image data which carried out picture compression when it was said block image 
which data modification produced in the case of said block image which has not produced data 
modification. 

[Claim 3] Said picture compression and elongation processing are an image data processor according to 
claim 1 or 2 characterized by using JPEG (Joint Photographic Expert Group). 



[Translation done.] 
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* NOTICES * 

Japan Patent Office is not responsible £or any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 

DRAWINGS 
[Drawing 1] 
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